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Abstract 

We consider a multi-class single server queueing network as a model 
of a packet switching network. The rates packets are sent into this net- 
work are controlled by queues which act as congestion windows. By 
considering a sequence of such congestion windows we allow the net- 
work to become congested. We show the stationary throughput of 
routes on this sequence of networks converges to an allocation that 
maximizes aggregate utility subject to the network's capacity con- 
straints. To perform this analysis we require that our utility functions 
satisfy an exponential concavity condition. This family of utilities in- 
cludes weighted a-fair utilities for a > 1. 



1 Introduction 

In this paper we are consider the behaviour of queueing networks under a 
limit where these networks become congested. We are interested in proving 
how end-to-end control can provide a mechanism so that routes receive a 
transfer rate that is the solution to a utility optimization problem. 

As a method of allocating resources and introducing fairness, work of 
Kelly [TT] considered utility optimization of the form 

maximize ^Jt/j(Aj) (1) 

iei 

subject to ^ Ai < Cj, j <E J, (2) 

i:jei 

over Aj > 0, iei, (3) 

where Ui is an increasing strictly concave utility function with derivative 
satisfying U-(Ai) — > oo as Aj — > 0. We call this optimization problem the 
system problem. In Kelly introduced proportional fairness as the unique 



solution to the optimization problem 

maximize fhi log A, (4) 

iei 

subject to ^ Aj < Cj, j G J, (5) 

over Aj > 0, iel (6) 

We call this optimization problem the network problem or the proportionally 
fair optimization problem. Kelly [TT] considered the combined solution of 
the network problem and the following user problems, for each i € I 

maximize Ui ( — ) — rrii 

Qi 

over fhi > 0. (7) 

This combined solution was considered under the relation 

fhi = Aiqi, i <E 1, (8) 

where qi = Yljei Qi an( ^ (?? '-3^3) are the Lagrange multipliers associated 
with the network problem. Theorem 2 of Kelly [11] found under ([8]) that 
the combined solution of the network and user problem gave the solution to 
the system problem. 

This result was constructed to suggest an end-to-end argument for pro- 
viding optimization and fairness across a communication network. The re- 
sult provided a method for decomposing the system problem into a user 
problem that is independent of the network structure except through pa- 
rameter qi and a network problem that is independent of user's preferences, 
except through parameter fh. Interpreted in the context of a communica- 
tion network this separated the preferences of users performing end-to-end 
communication and the network's preferred optimal behaviour. In [llj the 
solution is interpreted as setting prices (qj : j £ J) for sending traffic 
through the network. With these prices each user, i El, chooses an amount 
of money fhi it is willing to pay per unit of time. From this the user receives 
an amount of bandwidth Aj = 

By construction this result considers a static model and the end-to-end 
argument performed by users is implicit. Subsequent work has successfully 
used differential equations to add dynamics to this notion of optimization 
and decomposition [144 \7\ [T2"| I21j . Other work has considered the form of 
utility optimization achieved by different protocols [231 US US] . Also authors 
have also considered stochastic models of flow across a network [161 121 E] . 
More recently authors have explicitly used queue length as a mechanism to 
provide utility based fairness [22], [5] . 
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In 1979, Schweitzer [20] studied approximations of closed multi-class 
queueing networks and considered how asymptotic conditions on such net- 
works might satisfy the Kuhn- Tucker conditions for proportionally fair op- 
timization. In 1989, Kelly [10] studied approximations of closed queueing 
networks and by an analogous analysis considered a similar optimisation for- 
mulation. In 1999, Massoulie and Roberts p2] studied a fluid type queueing 
model and used these same Kuhn- Tucker conditions to deduce proportional 
fairness. Using large deviations and also heavy traffic analysis, recent work 
of Walton [21] and Kelly, Massoulie and Walton [T3] have provided rig- 
orous formalisations of the relationship between closed queueing networks 
and proportional fairness. The large deviations connection between multi- 
class queueing networks and proportional fairness gives a much more literal 
meaning to the network problem. 

In light of this work the first key observation of this paper is that we can 
use the asymptotic behaviour of a multi-class queueing network to express 
the network problem dUE]). Given this, (fhi : i 6 I) must represent the 
number of packets on each route of this network. We let (fhi : i € T) 
be recorded and controlled by congestion windows. In this paper for each 
route a congestion window sends packets along its route at a rate which is a 
function of number of packets on that route. We call this system of queues 
and congestion windows, a queueing system. 

We wish to associate the congestion windows in a queueing system with 
the user problem (|7|). The second key observations of this paper is that the 
user problem ([7|) is reminiscent of a Legendre-Fenchel transform. Results 
like the Gartner-Ellis Theorem [I] relate the large deviations behaviour of 
sequences of random variables to the Legendre-Fenchel transform of their 
log moment generating function. So by controlling the size of congestion 
windows in large deviations limit and by this Legendre-Fenchel transform 
observation, we are able to associate a utility function with a sequence of 
congestion windows. We interpret each congestion window in this sequence 
as a congestion controller's response to the level of congestion within the 
queueing system. We discuss these points more formally in Section [2j 

A third observation is that in our queueing system the statement ([8]) 
corresponds to the statement of Little's law, i.e. the expect number of 
packets across routes equals the expected sojourn time of packets through 
the multi-class queueing network multiplied by the rate packets are sent 
into the multi-class queueing network. Thus these three observations now 
place the work of [llj in the context of a network of queues with congestion 
windowing. 

The queues and congestion windows considered in our queueing system 
are quasi-reversible. Thus, as Theorem 14. 1 1 describes, standard reversibility 
results can be applied to calculate these queueing systems' stationary distri- 
bution. We consider a sequence of stationary queueing systems associated 
with a particular sequence of congestion windows. We study the large de- 
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viations of the stationary distribution of this sequence of queueing systems. 
In this large deviations limit our above three observations are realized and 
thus these queueing systems are asymptotically able to execute Theorem 2 
of Kelly [llj . In particular, Theorem 14.31 states this sequence of queueing 
systems obey a large deviations principle with rate function given by the 
system problem. 

max > UAKi) subject to / Aj < Cj, j G J . 

From this in Theorem 14.51 we prove that the stationary rate packets are 
transferred through these queueing systems converges to (A* : i 6 X) the 
solution the system problem. 

We note that now, instead of interpreting q and in as prices and wealth 
per unit time, we interpret them as round-trip times and congestion window 
sizes. In addition, the large deviations analysis taken in this paper leads 
us to consider analogues with the theory of effect bandwidths. We find in 
our analysis that we require each utility function to satisfy an exponential 
concavity condition, that the map A i— ► Ui(e x ) is concave. 

1.1 Organization 

In Section [2] we define our model of a congestion window. We study its 
stationary distribution when operating in isolation of a network. We study 
the large deviations behaviour of a sequence of congestion windows and we 
consider how to associate a utility function with this sequence. 

In Section [3] we consider a well known model of a multi-class queue. We 
study these queues' stationary distribution when operating in isolation of a 
network and we study their large deviations behaviour. 

In Section H] we connect together the congestion windows of Section [2] 
and the queues of Section [3] to form a queueing system. Similarly we study 
the stationary distribution of this queueing system and we study the large 
deviations of a sequence of queueing systems. In addition we study dual 
relationship between the state and the flow through the queueing system 
and we prove the stationary throughput of packets in the queueing system 
converges to the solution to the system problem. 

1.2 Notation 

We let finite set J index the set of queues in a network. Let J = \ J\. A 
route through the network is a non-empty subset of queues. Let I be the 
set of routes and let I = Z. For each route i = ■■■,jf..} we associate 
an order j l k ). Also we define the set of queue-route incidences, K, = 

ejxl: j'e i] and let K = \K\. 
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Our multi-class queueing system will process packets through a network 
of queues and congestion windows. For each route there is a congestion 
window. Let window size fhi be the number of packets in congestion window 
i Gl. Each queue j processes packets form routes i G I with j £ i. Let rriji 
be the number of route i packets at queue j. We also define, 

mj = ^2 m i*> 3 G ^ ( 9 ) 
i:jei 

as the number of packets at queue j. As each congestion window records the 
number of sent but not yet acknowledged packets in the queueing network, 

fhi = J ^2'mji, i Gl. (10) 

Although we will often use fh = (fhi : i G X) G Z+, m = (m^ : (j, i) E K) E 
to refer to the number of packets at congestion windows and queues, in 
Sections (12.20 . (|3.2|) and (|4.2p . when applying large deviations results, we 
will use fh G and m G to refer to the proportion of packets in the 
queueing system at different congestion windows and queues. 
In addition for m G Zj5 we define, 

/ mj \ _ rrij\ 

\ mji : i 3 j ) ~ Ur.jei( m Ji 1 )' 

For vectors x G and <j> G M^? we define ||x|| = (X)d=i a; i) 1//2 ' ^ ne -^ u " 
clidean norm of we define \ x\ = [\xd\ ■ d = 1, -D), the low integer part 
of each component of x and we define <ft ■ x = Y2d=i ^d^di the dot product 
of 4> and x. 



2 Congestion Windows 

Congestion windows keep a record of the number of sent but not yet acknowl- 
edged packets in a queueing network. The models of congestion windows 
considered here are reversible and thus lend well to product form results 
when incorporated into a network [101 [1] . In comparison to a queue a con- 
gestion window has exactly the opposite reaction to arrival and departure 
events: an arrival at a non-empty congestion window results in a decrease 
in the window size and a departure from the congestion window results in 
an increase in the window size. 

When in isolation of a network we define a congestion window (Mj(t) : 
t G M+) as a continuous time Markov chain on Z + with transition rates, 



gi(mi) ifm-=mi + l, 
Aj if fh • = fhi 
otherwise. 
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We refer to a transition ra; i— > m, + 1 as a departure event and for > 
a transition m; i— > mj — 1 is referred to as an arrival event or as an 
acknowledgement. For the purposes of this paper it will be convenient to 
define 

A i = e Al and 5i (m;) = e G i (m i +i)-G i (m i ) j 

where Aj G R and Gj : R + i— > [—00,00) is a strictly concave function. Thus 
a congestion window is defined by a constant Aj and a concave function Gj. 

2.1 Reversibility and stationary behaviour 

We now collect a result about the stationary behaviour of congestion win- 
dows. 

Proposition 2.1. A stationary congestion window is reversible with invari- 
ant measure, 

Proof. The result is immediate from the detail balance equations 

7Tj (fhi) = e^^-G^-V-^TTiirhi - 1) = ... = e^^-^Tr^O). 

□ 

2.2 Large deviations 

The rate at which packets are sent into a network by a congestion window is 
determined by the size of the congestion window, and the level of congestion 
in the network. We have denoted the size of the congestion window by fhi, 
we will denote the level of congestion in the network by c G N. For c £ N 
we define a sequence of congestion windows and study the large deviations 
behaviour of their stationary distribution. 

For each c G N, let M- be a stationary congestion window defined by Aj 

and G^(-), where G\ c \k) = cGj(- + ^— ) for function Gj strictly concave, 
differentiable on (0, 00) with derivative taking all values in (—00,00) and 
with {c^jcgN a bounded sequence with values in R. We define convex 
function G* : R — > R from Gj with the following Legendre-Fenchel transform 

G*(Aj) = max {Gj(mj) - AjTOj}. 

We may also define 

m* x . = argmax{Gi(mj) - \ifhi}. 



6 



Proposition 2.2. a) 

- oo 

lim - log Y e G\ e Hk)-*ik = G*(Ai), X( G 

c— too c — ' 



fe=0 



b) For rrii G (0, oo) and a bounded sequence {c^jceN such that crrii +c y ^ > G 
lim - logP(M( c ) = cm + a 4 (c) ) = G l {m i ) -\- G*{\)- 

c— >oo c 

Proof. To prove a) we wish to verify the principle of the largest term for 
this infinite sum [HJ Lemma 2.1]. First we show the upper bound. Let 
d = max c \d\°^\. Since Gi is strictly concave, \/5 > letting 

e = i min{G(m^) - G f (m^ - <S) + <5, G,(m^) - G,(m^ + 5) - 5} > 0, 
we have that for all fh G K+, 

Gi(rhi)—Xifhi < G* (Xi)—e(fhi—fh* x .)I[fhi > fh*+5]+e(fhi— m^.)I[m, < m*— <5]. 

Therefore applying the above inequality and comparing the following with 
a geometric sum we have, 



,(c) 



oo oo 
G< c) (fc)-A,fc 



<tf*(*+-ir)-Ai|] 



fc=0 



fc=0 



(c) 



(c) 



2(c<5 + d + 1) + 2 e «(!-™*) 
fcez + 

e -(c5-d-l) 



2(c<5 + d + 1) + 2- 



1 - e" 



(12) 



Hence as the first term in the square bracket dominates 
limsup-log^e G ' C) ( fc )- Afc < G*(\). 



k=0 



By proving the lower bound for a) we can simultaneously verify b). Using 
the terminology of b), for all fhi G (0, oo), 



Gi(mi) - Xi-nii 



lim -l OKe cGi( ™ l+ ^ + ^ ) ~ AlC ™ i+ ^ 



c— >oo c 



(13) 



1 oo 

<liminfilogy e G ' C) «- A ' fc . 

c— >oo c ^- 



k=0 



Taking rrii = mt. and <rj = L^t.J — mX. verifies a). Given a) and fjl3[) we 
have b). □ 
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We now emphasis the following duality between state and flow in conges- 
tion windows. Suppose as c — > oo the congestion window's state is approxi- 
mately cm* . Thus the flow out of the congestion window is approximately, 

g) (.cm; ) « exp < > > e « 1 ; . 

C 

When stationary the average outward flow of packets from the congestion 
window equals the average inward flow. Thus we have that G'^fh*) = Aj, or 
in other words, 

m* = argmax{Gj(mj) — Xifhi}. 

By this duality and the correct choice of Gi we can control the throughput of 
packets from the congestion window so that it optimizes a utility function. 

2.3 Utility optimization 

The arrival rate of packets into a congestion window is Aj = e Ai , thus the 
utility associated with Aj is Ui(e Xi ). We later find, if we wish to maximize 
the system problem, we must define U through the following user problem, 

- Gi(fhi) = max\Ui(e Xi ) - fhiXi}, rhi G M + (14) 

and similarly by the duality of Legendre-Fenchel transforms, we may define 
Ui from Gi by 

Ui(e Xi ) = min {A^, - G^rhi)} = -GJ(Ai), A, G E. (15) 

The function Ui(e Xi ) must be concave as G*(Aj) convex. Thus in order to 
optimize a utility function U we require the assumption, 

Assumption 1. T/ie utility function U is exponentially concave, that is the 
map Aj i — > Ui(e Xi ) is strictly concave on R. 

We also collect the differentiability assumptions that we make on Gj. 

Assumption 2. VFe assume Gi defined by is strictly concave, differ- 
entiable on (0, oo) with derivative taking all values in R. 

Remark 1 (Weighted a-fairness, a > 1). The weighted a- fair family of 
utility functions considered by Mo and Walrand f iff] /, corresponds to the 
aggregate utility of users with iso-elastic utility, that is utilities, 

[wilogAi ifwi<ER + , a = l. 
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The weighted alpha- fair class has proved popular as it contains proportional 
fairness (a = Wi = 1), TCP fairness (a = 2, Wi = and converges 

i 

to maximum throughput (a — > 0, Wi = 1) and max-min fairness (a — * oo, 
Wi = I). 

One can easily verify that £/j(Aj) is exponentially concave for a > 1 and 
that 

„ , _ s fhi fhi m 1 f mi x 

Gi{mi) = log = / log — dx. 

1 — a Wi 1 — a 1 — a Jq W{ 

So Ui and Gi satisfy the two assumptions above for a > 1. Thus our results 
apply for weighted a-fairness for a > 1. The case a = 1 is considered in 
\2J$ . For weighted alpha-fairness a > 1, a convenient form for gf 1 andG^f 1 
to take is 

1 rhj 

(c\, s /otA 0-1 , r( c )ta.i (cwi)^ 1 

gfUfhi) and e G * = ^ — - L ^~. 

\ m iJ (mi!) 



a-l 



3 Multi-class single server queues 

We define a multi-class single server queue. These queues are described in 
Kelly jBj . A queue j & J is fed packets from classes from the set of routes 
{% E T : j G i}. Packets occupy different positions within the queue and 
have an exponentially distributed mean 1 service requirement. Given there 
are rrij £ Z + packets at queue j, packets occupy positions l,...,mj. The 
total service devoted to these packets is Cj G (0,oo). This fixed service is 
then divided amongst the different positions in the queue. A proportion 
7j(/,mj) of this capacity is devoted to the packet at position / = 1, ...,mj. 
Upon completing its service a packet at position / will depart the queue 
and the packets at positions I + 1, ...,mj will move to positions I, ...,rrij — 1 
respectively. In this section we assume packets of route i arrive at queue j 
as a Poisson process of rate Aj. Upon arrival a packet will move to position 
I = 1, ...,mj + 1 with probability Sj(l,mj + 1) and packets which were in 
position I, ...,mj will move to positions I + 1, mj + 1. 

Let s J = (i\,...,imj) G I m \ for rrij > 0, give the state of queue j. Let 
T^un denote the arrival of a class i packet to position / in queue j and let 
TJ- « . denote the departure of class i the packet in position I. Thus the state 
of this queue forms a continuous time Markov chain with transition rates 
given by, 



q(s J , s'- 



Ai8j(l, mj + 1) for s' j = XV.^s J , / = 1, mj + 1, 
Cj~fj(l,mj) for s' J = TfjK s J , i\ = i, 1 = 1, ...,mj, 
otherwise. 
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3.1 Quasi-reversibility and stationary behaviour 

These queues are known to be quasi-reversible and their stationary distri- 
bution is well understood [U [8] . 

Proposition 3.1. A multi-class single server queue j G J is quasi-reversible 
and (Mji : i G 2,j G i) the stationary number of route i packets at queue j 
has distribution, 

(16) 

for rriji S Z + for each i G 2 such that j G i and provided the following 
stability condition holds, 

Proof. Let Mj be the number of packets at queue j. Since the queue does 
not discriminate between different packets' classes, Mj is a reversible Markov 
chain and thus its departures prior to time t form a Poisson process indepen- 
dent of the Poisson process of arrivals after time t. By thinning these Poisson 
processes with probability ^ A ' . we obtain the arrival and departure pro- 
cesses of route i packets and thus deduce that the queue is quasi-reversible. 
The stationary distribution of Mj is geometric with parameter A ' com- 

bining this with the same thinning argument and summing over states s 3 
obtaining (rriji ' i €. I,j E i) we obtain (|16j) . For more details see Kelly [HI 
Theorem 3.1] or Asmussen ^, §IV.4]. □ 

3.2 Large deviations 

We now collect some large deviations results on these queues |19l I24j . 

Proposition 3.2. For j G J , let (Mji : i &2,j G l) have distribution U6\) . 
a) Let m? = (rriji : i € I, j £ s) and o~i'^ = (a^f : i G 2, j G i), c G N 

be such that rriji £ su P c eN ll^'^ll < 00 an d crriji + G Z + \fi with 
j G i, then, 



1 



lim - log¥(Mji = crriji + af), Vi 3 j) = -Pj(m 3 ), 



c^oo c ■ ■■ ]i 



where, 



. ._. niji\i 
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b) The function j3j(m 3 ) is continuous, convex and is such that 

inf^V) = {° ' / >:;: - ;A ' ' ; ( ' r (17) 
m^>o — oo otherwise. 



Proof, a) Define = Y^i- jei a ji ■ By Stirling's formula 

lim - log(cm,j + er^)! = mu log ra,-j - m,j. 

c— >oo C ^ 

Thus, 

lim - logP(M,-j = cm,-i + er}7 ,i 3 j) 

moo J J J 



c-^oq c 

■ lim — 

c— >oo c 



A, 



log(cmj + crj c) )! - ^ log(cm i j + crj^)! + ^ (cm^ + o^) log — i 



<T (C) 

-Urn Y, m 3t \og {m3l + ^ C > = -Pj(m j ). 



rry>0 c ; 

b) Taking xlogx = for x = 0, xlogx is continuous on M + , thus /3j is 
continuous. We next prove fjlTI) . For two probability distributions p and q 
with the same support on /C, we define their relative entropy to be D{p\\q) = 
^2 s Ps log in particular one can verify 

minL>0||g) = (18) 
p 

and is minimized by p = q. Thus taking p = (— ^ : i € X,j € i) and 

g = ( E A ; a, :i£l »J' ei )» 



mf Pj(m J )= mf mj > log ^ + mj log ^ — = 

™ j >0 I ^ »'A y r A < 

■ f , gj JO if Er-jerAr <Cj, 

= mf rrij log — J —— = < Jt 
m j >o Erij'erAr I — oo otherwise. 

Finally to show that (3j(-) is convex one can verify that 

(5j{m?) = max mjifa subject to Aje 9 ^ < Cj 

over 0j £ M, i 9 j. (19) 

Thus f3j{-) is expressible as a Legendre-Fenchel transform and so is convex. 

□ 
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4 A queueing system 



In this section we consider a multi-class queueing network and we consider 
different traffic sources to correspond to different routes through this net- 
work. Via congestion windows routes now control the statistical character- 
istics of traffic in an end-to-end way. We study the large deviations of this 
network. We consider the stationary rate packets are sent across the net- 
work. We find that this end-to-end control is sufficient to attain rates that 
approximate the solution to the system problem (p3|3|). 

We now connect together our queues discussed in the last two sections 
to form a network. The queueing system we define in this section models 
a communication network with a fixed number of document transfers in 
progress. These documents are transferred by packets across the different 
routes of the network. The rate at which packets are sent is controlled in 
an end-to-end manner by congestion windows. 

We consider a network of queues indexed by the set J and congestion 
windows indexed by the set of routes X. Each queue j G J will process 
packets as described in Section[3]but arrivals will be prompted by transitions 
within the queueing system (rather than by a Poisson process). Similarly 
each congestion window will send packets into the network as described in 
Section [2] but arrivals into congestion windows will be prompted by the 
departures from the queueing network. 

In particular if with route i we associate route order (j[, j£ ), a de- 
parture from congestion window i will prompt an arrival at queue j\ . Also 
a departure of a route i packet from queue fy, k = 1, hi — 1 will prompt 
an arrival at queue and similarly a departure of a route i packet from 
queue j l k . will prompt an arrival at congestion window i. In this way packets 
are sent into the network, transferred along their route and finally acknowl- 
edged. 

We more explicitly describe the state of our queueing system as follows. 
As in Section [3] we let s ] = (i^, ...,i J m -) record the state of queue j and let 
s = (V : j G J) record the state of our queueing system. Also we let fin 
record the state of congestion window i and let fh = (fhi : i G X) record the 
state of our congestion windows. Finally let s = (s, fh) record the explicit 
state of our queueing system. We define the transitions in our queueing 
network as follows. Let s *— > T*/ . «s define the transition corresponding to 
a route i packet departing congestion window i and arriving at position / 
in queue j. Let s i— > Thn [j 1 v)§- denote the departure of a route i packet 
from position I of queue j which arrives at position V in queue j'. Finally 
let s i— > Th s denote the departure of a route i packet from position I of 
queue j which arrives at congestion window i. 

We define our queueing system to be a continuous time Markov chain 



12 



with the following transition rates 
gi{fhi)5j(l,mj + 1) 



fors' = T* ( . s, j=j\, 
I = 1, ...,mj + 1, 
C r )6 r (/', m 3 -/ + 1) for gf = T^^^^s, j = f k , 

3 = Jk+i k = I, hi — I, 



Cj"fj(l,mj) 




ij = i I' = 1, rriji + 1, 
for £ = T" m s, j = 4, ^ =i. 
otherwise. 

(20) 

Also like in Section [31 we let m = (rriji : (j, i) € /C) record the number of 
route i packets at queue j. Also recall the expressions for rrij and m%, ([9|) and 
(|10p . the number of packets in each queue and in each congestion window. 
Finally recall we define Gi from gi by the relation gi(fhi) = e G ii m i+ 1 )- G i( m i) , 



4.1 Quasi-reversibility and stationary behaviour 

From Proposition 12.11 and Proposition 13.11 we see our queueing system con- 
sists of a network of quasi-reversible nodes. Thus as considered in Kelly 
[9] networks of quasi-reversible nodes have a stationary distribution that is 
described by multiplying the distributions (fTT|) and (fT6|) . We prove this in 
the following theorem. 

Theorem 4.1. For a stationary queueing system defined by rates Ii20\) . Let 
M = (Mji : (j,i) £ JC) record the stationary number of packets of each route 
at each queue, then M has distribution, 

1 



P(M = m) 



in 



C j 



,Gi(nii) 



m € 



(21) 



mji : % 3 j 



1 



ip 



,Gi{mi) 



where, 

e n 

Note that distribution P(M = m) is not a product form stationary dis- 
tribution because we require the constraint rfij = X^gi m ji> ^ 

Proof. A good candidate for the time reversal of this queueing system is de- 
fined by rates q(-, •), where packets follow route i in reverse order (j l k ,, 
where queues j € J operate at capacity Cj with 5(l,rrij) = jj(l,rrij) and 
7j(/,mj) = 5j(l,rrij) and where, as before, congestion window i € X sends 
packets into the network at rate gi(fhi) = e G i( m i+ l )- G d m i) . "We show 



7T s 



n * IP ''"" 1 



iei 
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forms an invariant measure for our explicit Markov chain description. We 
verify Kelly's Lemma [8, Theorem 1.13] for our three types of transition: de- 
partures from congestion windows, transitions between queues, and arrivals 
at congestion windows. 

A departure from congestion window, for j = j\, 1 = 1,..., mj + 1, 



9(T^ m a,8) C nj (l, mj + 1) 



iris 



A transition between queues: for j = j|, j' = k = l,...,ki — 1 

I' = 1, niji + 1, 

Q{s,Tl jl){j , v) s) = CM&m^jl', m'j + 1) = ^( T o-,o,qv,/0)S 

^ T (i,0,(i','')-'-^ c jHj'(!> m i' + With m i) 

An arrival at a congestion window i, for j = j l k . , i = ij 



7r(s) 



q(s, T. 



Cj7j( l , m j) 



7r(s) 



Q(T l {j l) .s,s) gi ( mi - 1)83(1, mj) 

This verifies Kelly's Lemma and thus tt(s) is an invariant measure. Note 
Bq is expressable as 



*c= e n 



rrin 



iriji : iB j 



n 



Xi \ m ii 



Gi(mi)-Ximi 



for all A G M. 1 . By Assumption 2 the function fhi 1— > Gi(rhi) — \rhi is 
bounded from above for all Aj . Applying this upper bound and choosing A G 
MJ such that X]jgi eAi < Gj, the sum for Bq is finite. Thus summing over 
states of invariant measure tt(s) gives the stationary distribution (|2ip . □ 



4.2 Large deviations 

We now study the large deviations behaviour of our queueing system. We 
let a sequence of congestion windows congest the queueing system and we 
study its large deviations behaviour. We will relate the most likely state in 
our queueing system to the solution of the system problem. 

We use the same notation from Sections [2] and [3j We also assume as- 
sumptions[T]and[2]hold. As in SectionEJ we consider a sequence of congestion 

windows defined by G { f' \k) = cG t (\ + for % G T, c G N. Here d is 
expressible in terms of utility function U{ by (I15p . We define the function, 

(3 GjX (m,m) = rriji log ^ , 3 - V/tG^m*) - A^m;}, (22) 

(j,i)eK: 3 iel 

m,ji>0 
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for m G M+, fh G and Aj G R 1 . We use the shorthand that Pg = Pg,x 
for A = and we also use the shorthand /3c(m) = f3G{m ) fh) when fhi = 
m ji f° r au * G X. We define, 

/3g = min mjj log — ^— - — Gi(rhi) subject to mj, = m;, i 6 X 

(j,i)etC: mj iei j 

mji>0 

(23) 

over m G R+, fh G R+. (24) 

For each c G N, consider a stationary queueing system defined by rates (|2U|) 

with cong estion windows defined by G- c) (-), * G X. Let = {M$ : 

(j, i) G K,) record the stationary distribution of the number of packets on 
each route at each queue in our queueing system, (f2T1) , We characterise 
the large deviations of our sequence of queueing systems with the following 
theorem. 



Theorem 4.2. The sequence M.^ } c G N obeys a large deviations principle 

<h„+ „•„ fnm «77 n r- 



mf/i good rate function @g{')- That is for all D C 1D " A 



- inf (/fc(m) - 0%) < liminf P^ (— G D 



< limsupP (c) (— G -D) < - inf (/3 G (m)-^). 



V C / m£fl 



Proof. Assuming Aj G satisfies 



We define a product form stationary distribution on Z5" x Zi. with, 

(25) 

m G and m G Z+ where, 



Note by (fT2|) in Proposition 12.21 l?( c ) is finite. Note that P( c ) is expressible 
in terms of p( c ) through the conditional probability, 

P (c)( M (c) =m) = pW( M (c) = m | = J2 M ji\ * G J ) 
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for m G Zjf. By proving large deviations results about p( c ) we are able to 
prove a large deviations principle for p( c ). First, Proposition 13.21 and the 
definition of Ui (1151). we have that 



lim -log5 (c) = -V Ui{e K ). 

iei 

Thus by Proposition 12.21 and Proposition 13.21 for m 6 R+, m £ R^. with 
bounded sequences G R+ and £ R+ c G N such that cm + a^ G 
and cm + cr( c ) G Z^ we have that 

-/3 GA (m,m)+V[/i(e Al ) = lim - log P (c) (M (c) = cm+a {c) , M (c) = cm+a (c) ) 



c— »oo c 



Take E C Rf x R{, either open or more generally such that V(m, m) G 
E there exists a sequence as described above with cm + G Z+ and 
cm + ct( c ) G Z+ such that (m + rh + ^--) G E eventually as c — > oo then 

- inf p GX ( m ,m) = - inf lim - log P (c) (M< c ) = cm + cr (c) , M (c) = cm + a {c) ) 

(m,m)G-E ' (m,m)£E c^oo c 

1 / M (c) M (c) \ 

<liminf-logP (c) (( — ,— )££) (26) 

c^oo c V C C / 

This gives us a large deviations lower bound for P( c ). We prove the up- 
perbound by using the Gartner-Ellis Theorem |H Page 44]. We study the 
moment generating function of P( c ) , for 8 G R^ and <fi G M 1 



Ee' 



oo otherwise. 
Thus combining Proposition 12.21 part a) and proposition 13.21 part b), 

FM)= limilogEe^^^ 

c— >oo c 

= f E ie x ^(e A " U^e^) if E i:i6i e Al+ ^ < C 5 , j G J 
1 oo otherwise. 
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Thus F has Legendre-Fenchel transform, 

F*(m,m) = max^m^, + ^m^ + fee* 4- * 1 ) - £/;(e A! ) 



if ■ 
I ji 



subject to e x i+en < c j , j £ J 



i:jei 



max < 



ji i 
+ V maxf^(^) - Ui(e^) - +X i )\ 

+ ^Aimi-^C/i(e Ai ) 

i i 



In the third equality we apply (I19p to the first maximization and the user 
problem (|14p to the second maximization. From this the Gartner-Ellis The- 
orem [U Page 44] proves that for all closed sets E C x 

limsup-log]p( c )((— ( } ,— )ge]<- inf (/3 G A (m, m)-V Ui(e x *)) . 
c^oo C V C C / (m,m)£E V ' ^— ^ / 

(27) 

In particular we are interested in the closed set E = {(m, m) : J2jei m ji = 
nii, i G X}. Note if m € and sequence cr^ G M+, c G N, is such that 
cm + cr( c ) G and defining = X^jei then (cm + 0"( c ), cffl+ff^) G -B. 
So we may apply lower bound (|26|) to E 1 and also apply upper bound ((271) 
to this choice of E. Hence we have that, 

hm - log P< c ) (J2 M fi =^ c \iel) = (5h-Y. U * ^ ) • ( 28 ) 

j'€i i 

Or put otherwise we have for the normalising constant B G ( C ) , 

Um-logB G(c) =-P G . (29) 

c— >oo c 

From (|25|) combining (|28|) with large deviations upper bound (|27|) . for all 
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closed sets D G letting D' = {(m, m) : m G D} C E we have 

1 / n / M (c) 
limsup-logP (c) ( — efl 

= lim sup ( - log jp< c > f ( — ,- () )GD')-- log P(Y Mf = , i e 2)) 

c^oo \c Vcc / c y 

<- inf /3 G (m) + 0* G . 

m<=D 

This proves the large deviations upperbound for p( c ). The lower bound 
follows similarly by combining (I28D with lower bound (|26p . □ 



4.3 Duality between state and flow 

An important phenomenon we find from our large deviation analysis is that 
the limiting state of our queueing system and the limiting flow through 
our queueing system are dual. We demonstrate here that dual form of 
the optimization problem (I23H24|) found in our large deviations analysis is 
exactly the system problem (Q313]). 

Theorem 4.3. 

[3q = min niji log — — — ^ — Gi(rhj) subject to rriji = fhi, i G I 

meR + (?',*) e/C: 3 iei jei 

m£W + mj> o 

(30) 

= max UAKi) subject to A, < C,-, j € J. (31) 

+ i£X i:jGi 

Moreover, vector (m* ,fh*) G R^xl^. optimizes VJCty and A* G R£ optimizes 

(WW 



J2m*i = fh*, ViGT, (32) 



, * A * 



mjA^m*^-, V(j,i)G/C, (33) 
gG'^mj) = A * ; Vz G X. (34) 

.Here is £/ie derivative of the function Gi . 

Proof. Note the Lagrangian of optimisation problem (I30p with Lagrange 
multipliers A = (Aj : i G X) is exactly /fe^ as defined by (|28|). Minimizing 
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this Lagrangian we have 

min Bq \(m, m) = min log — 3 — — 3 - — GAm) + A; (fhi — m,-. 



mm 



Erriji log J ' X J \ - max Gi(fhi) - Xifhi \ (35) 

1 — oo otherwise. 

In the final equality we apply Proposition 13.21 b) and definition (|15|) . Thus 
the dual of optimization problem (f30l) is, 

max ^Ui(e Xi ) subject to ^ e Xi < Cj, j £ J. 

By the strong duality of optimization problem (i30|) and (f3T1) we have that 
expressions (f30|) and (f3Tj) are equal. 

Now we demonstrate the only if part of the equivalence with (|3ll) . Sup- 
pose A* optimises f)31 1) . We now consider how our Lagrangian behaves for 
A = (log A* : i € T). From (j35j) we see (m*,m*) must solve 



min <^ Giirhi) - m log A* } = -Ui{\*), i € I, (36) 

nii>0 { 



rrij>0 



From (f3"6"|) we see that e G ^ m ^ = A*. We now consider (|37|) if to* = then 
((371) is satisfied and so is (|33|) . If to* > then given relative entropy result 

(USD, U37D can only hold if £\ A, = Cj and § = ^ for all i € 1 such 

that j G i. Thus both flM} and ([M]) hold. 

Conversely if (|33|) and (|34|) hold then substituting to* and to* into the 
objective function of optimization problem (|30l) gives that 

(j,j)e/c i -iei iei iei 



m*>0 



In the final equality we use Legendre-Fenchel transform expression (|15|) . 

Thus to* attains the optimal value Yli U% (A* ) and thus is optimal for (f30l) . 

_ □ 
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4.4 Most likely state and convergence of throughput 

We now study the most likely behaviour of our stationary sequence of queue- 
ing systems , c G N. Section I3~2l suggests our sequence of queueing 
systems implicitly solve the system problem ([T][3]). This section formalizes 

this assertion. We show the sequence of stationary queueing systems ^ , 
c € N collapses to the solutions of the primal optimization problem (]23H24p . 
From this we show the stationary rate packets pass through the network 
converges to the rate allocation solving the system problem. We define the 
manifold 

M = {m G 1R+ : rrijiCj = mjA*, (j, i) G /C, G-(mj) = log A*, i G 1} 

where (A* : i G X) is the optimal solution to the system problem (QJ3]). 
From Theorem 14.31 we know that A4 is the set of solutions to the primal 
optimization problem (|23M24p . The stationary sequence of queues ^- , c G 
N, considered in Section 14.21 converges in probability to the set of solutions 
M. 



Theorem 4.4. 

-> 0. 



PW( inf — -m >e) 

V m£M C ) 



Proof. For e > 0, let M e = {ra G : mi m >(z M \ \m - m'\\ < e}. As M is 
closed and compact 

(3* Ge := mm. V mji log m i iC i - V" G^rhi) 
mew + m . >0 

subject to m ^ M. e: rriji = fhi, i G I 
jei 

>p G , 

where we recall Bq from (|23H24|) . Thus by Theorem 14.21 for all e > 

1 t \ f , , M (c) , , \ 
Urn sup- log PW( inf — - m \\> e ) < -B* r f + 3%. 

Thus Ve' G (0,3q e — 3q) eventually as c — > oo 

F (c)( inf ||^ (C) _ m ||> e N )< e -^&, E -/3&)+-' , . 



□ 
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The stationary throughput of route i packets in our queueing system can 
be expressed as 



A (c) =E (c) e Gf)(M« + l)-GW(M i ) ) i€ J. 

That is the stationary rate packets are sent into the queueing network by 
the i-th congestion window. We now show that this rate converges to the 
solution to the system problem (A* : i G I). In this sense our sequence of 
queueing systems implicitly solve the system problem. 



Theorem 4.5. 



A 4 (c) ► A?, iel. 



Proof. We first describe a modification of measure P( c ) that will be useful to 
us. For fixed i G X we let P^ be the stationary distribution of a queueing 
system defined by the same rates as P( c ) except that the i-th congestion 
window is defined by G^f' '(to*) = G^ifhi + 1). Observe for all m G 

E «0 U c) (^ (c) +i)-^ (c) (^ (c) )i[M( c ) =m}} =—Y\( mj ■ ) "4f x TT 

= J<lpW(M( c ) =m ) (38) 

Also by definition G^f^rhi) = Gi(^- + ^— ), thus corresponds to taking 

d^ = dj + 1. The precise values of the bounded sequence {d^} cS N do not 
determine any of the large deviations behaviour of p( c ) , thus both p( c ) and 
p( c ) exhibit exactly the same large deviations behaviour. Hence given (|29p 
and also Theorem 14,21 we have that 



e G r {m r ) 



lim - log ^f^- = 0, lim P (c) f inf [| — ( ) -m|| > = 0. (39) 

c-+oo c Bq( c ) c— >oo V m£M C I 

Now let (m*,m*) be an optimal solution to the primal optimization 
problem (|23H24|) . by assumption as G{ is differentiable with a continuous 
derivative at to*. Thus by the Mean Value Theorem Ve' > Be > and 
d G N such that Mod and Vm-j > with |m,j — rh*\ < Je we have that 

i Gfifhi+iyGfimi) _ p G<(m?)i 



< xp| ^ ^ ^| -exp{G i (m i )} 

c 



<e'. 
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We can now show that eventually as c — > oo 
E 



^ c) (M< c >+l)- G ( c) (M^) _ p G[{fn*) 



< e' 



m*\ < Je) + e 



m*\ > Je 



c 



+ E( c ) e G « (c) (^ c)+1 )- G i C) ^ c) )l 



< e ' + e G' i K)p(c)( inf 

\m£M " C 



l M * (C) -*!w" 
— — mA > Je 

1 c 1 ~ 



m > e 



+ 



%!p( C )f inf ||^ (C) _ m ||> e 



B. 



mGM C 



J J_ »Gi(*J)_-cO%.-/%)+«" , p c £ " -c(/3J i£ -/3J)+ce" 



In the second inequality we make the substitution (I38p , in the third inequal- 
ity we apply and we take 2e" < (3q e — (3q- As e' is arbitrary the result 
holds. □ 



5 Conclusion 

Previous work has considered the solution of the system problem by analysing 
differential equations. In this paper we have shown that this same notion 
of utility optimization can be solved by considering queueing networks with 
end-to-end control. This leads us to consider different interpretations of 
Kelly's decomposition results. This work emphasises the duality between 
the flow through a network and its state and also emphasises the variety of 
fairness achievable by end-to-end control. 
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